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Abstract 

Low-Density Parity-Check (LDPC) codes received much attention recently due to their capacity-approaching 
performance. The iterative message-passing algorithm is a widely adopted decoding algorithm for LDPC codes [7]. 
An important design issue for LDPC codes is designing codes with fast decoding speed while maintaining capacity- 
approaching performance. In another words, it is desirable that the code can be successfully decoded in few number 
of decoding iterations, at the same time, achieves a significant portion of the channel capacity. Despite of its 
importance, this design issue received little attention so far. In this paper, we address this design issue for the case 
of binary erasure channel. 

We prove that density-efficient capacity-approaching LDPC codes satisfy a so called "flatness condition". 
We show an asymptotic approximation to the number of decoding iterations. Based on these facts, we propose 
an approximated optimization approach to finding the codes with good decoding speed. We further show that 
the optimal codes in the sense of decoding speed are "right-concentrated". That is, the degrees of check nodes 
concentrate around the average right degree. 

Index Terms 

Low-Density Parity-Check Code, Decoding Convergence Time, Density Evolution, Binary Erasure Channel 

I. Introduction 

Low-Density Parity-Check (LDPC) codes are generally decoded by the iterative message-passing al- 
gorithm [7]. An important design issue is finding the codes with fast decoding speed while maintaining 
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good capacity-approaching performance. That is, the bit error rate approaches zero with few decoding 
iterations while a significant fraction of channel capacity is achieved. Such codes are desirable because 
they have less decoding computational complexity and delay. 

Despite of its importance, this design issue received little attention so far. In this paper, we address this 
design issue for the case of Binary Erasure Channel (BEC). BEC is widely adopted as a practical channel 
model for packet network communications. In addition, previous research has shown that the insights 
gained from the case of BEC can generally be carried over to the cases of many other channels. 

"Density Evolution" (DE) is an asymptotic analysis method for LDPC code performance under the 
message-passing decoding [5]. DE iteratively calculates the probability distributions of messages for 
the case where the codeword length is infinity. For a code with sufficiently long codeword length, the 
corresponding distributions of messages are close to these of the infinitely long codes. Hence, the code 
performances can be approximately determined, such as, bit error rates or message erasure probabilities 
in the case of BEC. 

Given that the message erasure probabilities can be approximately calculated, a brutal force approach 
to finding LDPC codes with good decoding speed is solving a constraint optimization problem. The 
optimization variables are the code parameters. The objective function is the number of decoding iterations, 
which can be approximated calculated by DE. And the constraints includes the fixed code rate, the 
condition ensuring that the code can be successfully decoded, and the valid ranges of the code parameters. 

Although the above brutal force approach can yield certain codes with good decoding speed, it is 
not satisfactory due to the following reasons. First, the constraint optimization problem does not have 
nice numerical properties. The objective function is discrete and indifferentiable. Almost all optimization 
algorithms have convergence problems. It is numerically difficult to find the optimal solutions. Second, 
the approach does not provide a closed-form relation between the number of iterations and the code 
parameters. Therefore, we can not gain any insight into the problem. 

We propose an alternative and tractable approach in this paper. We prove that "density-efficient" and 
"capacity-approaching" LDPC codes satisfy a so called "flatness condition". By "capacity-approaching", 
we mean that the code rate is close to the channel capacity. By "density-efficient", we mean that the 
density of the parity-check matrix is low. In this paper, we only consider codes with efficiently low 
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parity-check matrix density and low maximal left and right degrees. The codes with high parity-check 
matrix density or high maximal degrees are not practical in implementations. 

The flatness-condition simplify our discussion on decoding speed. Based on that, we present an asymp- 
totic approximation to the number of decoding iterations. The asymptotic approximation yields an approx- 
imated optimization approach to designing codes with good decoding speed. Instead of minimizing the 
number of decoding iterations directly, the approximated optimization approach minimizes the asymptotic 
approximation. Numerical results confirm that the number of decoding iterations and its asymptotic ap- 
proximation are consistent. The approximated optimization approach also has better numerical properties. 
The convergence problem in the brutal force approach is avoided. 

The asymptotic approximation provides a closed-form relation between the number of decoding itera- 
tions and the code parameters. Hence, it provides useful insights into the design problem. One part of the 
discussion in this paper on optimal degree distributions in the sense of decoding speed is based on this 
closed-form relation. We also anticipate that this closed-form relation will facilitate further discussion on 
decoding speed in the future. 

We also discuss the conditions for the optimal degree distributions in the sense of decoding speed. We 
show that the optimal codes are "right-concentrated". That is, the degrees of check nodes concentrate 
around the average right degree. In previous research, several such degree distributions are numerically 
found to have nice performance 

The remainder of this paper is organized as follows. In Section [ill we review LDPC codes, the message- 
passing decoding, "density evolution", and the density capacity-approaching tradeoff. Readers who are 
familiar with these materials, can skip this section. In Section [nil we discuss the flatness condition and 
asymptotic approximation to the number of decoding iterations. In Section |lVl we discuss the proposed 
approximated optimization approach for finding codes with good decoding speed. In Section |Vl we discuss 
the conditions for optimal degree distributions in the sense of decoding speed. In Section |Vll we show 
several numerical examples. In Section IVIll we present our conclusions. 
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Fig. 1. The Binary Erasure Cliannel 



II. Preliminary 



A. Binary Erasure Channel 

A BEC is shown in Fig.[T] The channel takes binary inputs and outputs 0, 1, or e, where e stands for an 
erasure. The transmitted binary signal is received correctly with probability 1 — Otherwise, the channel 
outputs an erasure. The probability ^ is called the channel parameter. The channel capacity C = 1 — ^. 

B. LDPC code 

LDPC codes are linear block codes with sparse parity-check matrix. The codes can be represented by 
Tanner graphs. A Tanner graph is a bipartite graph. One of its partition consists of variable nodes; whereas 
the other partition consists of check nodes. Each variable node represents one codeword bit; while each 
check node represent one linear check. A Tanner graph is shown in Fig. |2| The variable nodes are drawn 
as circles; whereas the check nodes are drawn as squares. 

In this paper, we consider randomly generated LDPC codes. The Tanner graph is generated according 
to the three code parameters: the left degree distribution \{x), the right degree distribution p{x), and the 
codeword length N. The left and right degree distributions are polynomials: 



where Aj is the fraction of edges connected to variable nodes with degree i; while pj is the fraction of 
edges connected to check nodes with degree j. The Tanner graph is generated by first growing edges from 
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Fig. 2. The Tanner graph representation of Low-Density Parity-Check codes 

variable and check nodes according to the degree distributions. The edges from variable nodes and check 
nodes are then uniformly randomly connected. If the codeword length is sufficiently long, approximately 
the code rate 



C. Message-passing Decoding 

The message-passing algorithm [7] is an iterative decoding algorithm. The algorithm computes likeli- 
hood functions for all codeword bits iteratively. The final decoding decisions are hard threshold decisions 
on the likelihood functions. 

In the case of BEC, the likelihood function has a finite alphabet. The message-passing algorithm becomes 
simple. During each iteration, the algorithm find check nodes with only one neighboring variable node 
being still erasure. The algorithm then corrects these erasures according to the linear constrains. 

D. Density Evolution 

Density Evolution [5] calculates the distributions of messages for the codes with infinitely long codeword 
length. In the case of BEC, the message erasure probability pP after the l-th iteration can be approximately 
calculated as follows: 



R = l- 



jl\{x)dx 



(3) 



pp - m - p{-^ - pf^)) 



(4) 



Asymptotically with the codeword length, the code can be successfully decoded with high probability if 
and only if 

^X{1 - p{l ~ x)) < X for any X e (0,^] (5) 

E. Density Capacity-approaching Tradeoff 

It is shown that LDPC codes with bounded degrees can not achieve the channel capacity. There exists 
a tradeoff between the parity-check matrix density and the achievable rate [1] [9]. In the case of BEC, 
ShokroUahi [3] shows the following bound for achievable rate: 



1/a = / p{x)dx (7) 



where, a is the average right degree. 



and AR is the gap between the achievable rate to the channel capacity. This lower bound of the gap to 
the capacity decreases exponentially as the average degree increases. In the same paper, ShokroUahi show 
that this bound is tight. That is, there exist codes with an exponentially decreasing gap to the capacity 
with respect to linearly growing average degrees. 

III. Flatness Condition and Asymptotic Approximation to the Number of Iterations 

In this section, we prove that density-efficient capacity-approaching LDPC codes satisfy a necessary 
condition - the flatness condition. Based on the flatness condition, we further derive an asymptotic 
approximation to the number of decoding iterations. 

The propositions and lemmas in Section ITlI-BI are not meaningful by themselves. They are useful only 
for proving the main theorems in Section IIII-Cl A reader who is not interesting in the details of the proof 
can skip the section HIl-BI 



A. Notation and Definition 

Consider a BEC with channel parameter ^. Consider a LDPC code with the left degree distribution 
A(x) and the right degree distribution p{x). Denote the average right degree by a. Define b = 1/a. Let 
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R denote the code rate. The gap between the capacity and the code rate AR = C — R. We define the 
function B(AR,b, x) as follows: 



We define the decoding convergence time to be the maximal / such that the message erasure 
probability is greater than the probability level r] after / decoding iterations. For any left and right degree 
distributions A(x) and p(x), we define 



Throughout Section HUl the derivatives are taken with respect to x. Throughout this paper, we also 
assume that the maximal left and right degrees are upper bounded by k^a and kca respectively, where 
and kc are constants. 

B. Auxiliary Propositions and Lemmas 

The proofs can be found in the Appendices IXlto iHl 
Proposition 3.1: 




(8) 




(9) 



Pil-x)<{-l)[p{l-x)]'< 



k^a 



p(l — x), for any x G (0,,^] 



1-e 



(10) 



Proposition 3.2: 



[pil - x)]" < i-l) 



k^a 



[p{l — x)]', for any x G (0, ^] 



Proof: Similar to that of Proposition 13.11 



Lemma 3.3: 




(11) 
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Lemma 3.4: 

p{l-x) 



> 1 - y/kcB{AR, b, x), for any x e (0, (12) 



Lemma 3.5: 



|[A(1 - p(l - < '-''[I'sf^' + Kklp(l-.W (,3, 



Lemma 3.6: Let 6^ + 6^ < ^ and b^ < x < ^-b'^. Then, 



kca 



[p{l-x)]' - ' ' ' ' ' ' ^ 2(1-0^ 1-e 



Lemma 3.7: Let Xq e (0, and Xi — ^A(l — p(l — Xq)). Then, 



for i = 0, 1. 

Lemma 3.8: For x e (0,{), 



Lemma 3.9: If 6 < (1 — i)/kc, then 



(14) 



(15) 



\^^-pi^-^^< ^;^^ (16) 



2b AR 



C. Main Theorems 

Let us consider a BEC with channel parameter ^. Consider a sequence of degree distribution pairs: 

(Al,Pl),--- ,(An,Pn),--- (19) 

where 

Xr,{x) = J2Kix'-' (20) 



Pn{x) = ^pnjX^ ^ (21) 
j 

are the left and right degree distributions respectively. Each pair of degree distributions defines a code. Let 
an denote the average right degree for the n-ih. code. Define 6„ = l/a„. Let _R„ denote the rate of the n-th 
code. Let A_R„ denote the gap between the capacity and the code rate for the n-th code, Ai?„ = C — R. 
Then we have the following theorem. 

Theorem 3.10: If 6„ is strictly decreasing with lim„^oo bn = 0. The gap Ai?„ is strictly decreasing and 

lim (22) 

The successfully decoding condition holds: 

^\n{l - p„(l - x)) < X, for any x E (0, ^] (23) 

The maximal degrees of and pn are upper bounded by A;^a„ and /cc^n respectively, where fc^, and kc 
are constants. Then as n ^ oo, the derivative of ^A„(l — p„(l — x)) with respect to x converges to 1 
uniformly with respect to x in the interval (0,^]. 

Proof: The proof is in Appendix |l| ■ 
According to this theorem, the function ,^A(1 — p(l — x)) becomes flat as the code rate approaches the 
channel capacity and the parity-check matrix density remains efficiently low. Based on this conclusion, 
we prove the following theorem, which shows an asymptotic approximation to decoding convergence time 
T 

Theorem 3.11: Let r/ be a fixed probability level, < < ^. If 6ri is strictly decreasing with 
lim„^oo bn = 0. The gap Ai?„ is strictly decreasing and 

lim - (24) 

The successfully decoding condition holds: 

^An(l - p„(l - x)) < X, for any x E (0, ^] (25) 
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The maximal degrees of A„ and p„ are upper bounded by A;„a„ and kcttn respectively, where ky and kc 
are constants. Then as n ^ oo, the ratio 

F(A„,p„,r/)/T^ (26) 

goes to 1. 

Proof: The proof is in Appendix Ul ■ 

Remark In the above theorems, we assume that ARn decrease polynomially with respect to 6„. According 
to Section III-El in the most efficient tradeoffs, Ai?„ decreases exponentially with respect to 6„. We 
conclude that this condition is generally satisfied in practical applications. 

IV. Approximated Optimization 

A brutal force approach to finding the LDPC code with minimal decoding convergence time and a 
fixed gap to the capacity is solving the following constrain optimization problem: 

minT^ (27) 



subject to 

^A(l -p(l -x)) < X for X G (0,^] (28) 
p(x)dx 

■^V^ ^ — = 1-C + AR (29) 
/o A(x)dx 

^ Ai = 1, pj = 1, Ai > 0, and pj > (30) 

« j 

Where C is the channel capacity, and < AR < C is a fixed gap to the channel capacity. The condition 
in Eqn. |28l is the successful decoding condition. The condition in Eqn. |29l imposes that the code rate is 
C — AR. The constraints in Eqn. |30|come from the probability nature of degree distributions. 

However, the above optimization problem is not tractable. The objective function is not differentiable. 
This brings in convergence problems for optimization algorithms. To get around these difficulties, at this 
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point, we invoke Theorem 13.111 and replace by F{X,p,ri). This yields the following approximated 
optimization problem: 

min F(A, p, 77) (31) 



subject to 



CA(1 -p(l -x)) < X, forxe(0,^] (32) 



X{x)dx 



1-C + AR (33) 



^ Ai = 1, J2pj = 1, Xi> 0, and > (34) 

i j 

The numerical results confirm that the approximated optimization has nice numerical properties. 

V. Optimal Degree Distribution 

In this section, we discuss the conditions for the optimal degree distributions in the sense of convergence 
speed. We show that the optimal codes are right-concentrated. 

A. Low Erasure Probability Region Convergence Speed Analysis 

In practical applications, the probability level rf is generally small. The number of decoding iterations 
while the erasure probability is in a low erasure probability region may constitute a large fraction of the 
decoding convergence time. That is, the decoding speed in the low erasure probability region dominates 
the overall decoding speed. 

We show in this section that if the average right degree is fixed, then the right-concentrated degree 
distributions have optimal decoding speed in the low erasure probability region. 

Note that the relation between Pi'^ and P^^^^ can be also written as follows: 

y = p{l- Pi^)) (35) 



(36) 
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P(l-x) 







Fig. 3. The iteration process of erasure probabilities 

where y is a auxiliary variable. The iterative process of pP is illustrated in Fig. |3l To increase the 
decoding speed, we need to move the curve p(l — x) upward and the curve 1 — A^^(x/^) to the left. 
Moving the curve p(l — x) upward is equivalent to making the function p(l — x) larger. Moving the curve 
1 — A^^(x/^) to the left is equivalent to making the function A(l — x) smaller. To have fast decoding 
speed in the low message erasure probability region, we need to make p{x) large for x near 1 and X{x) 
small for x near 0. 

We need the following auxiliary lemma for proving the main theorem in this section. 

Lemma 5.1: Let 7(x) be a degree distribution with average degree a and maximal degree d > ?>. 
Assume 7i > and 7^+2 > 0, for 1 < i < rf. Then another degree distribution 7(0;) with the same average 
and maximal degrees can be constructed as follows: 



where /9 is a sufficiently small positive real number such that 7(x) is well defined. We also have 




(37) 



7(x) < 7(x), for 



I 



(38) 



< X < 1 



i + 2 
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1 

7(x) > 7(0;), for < X < (39) 

i + 2 

Proof: The proof is in Appendix iKl ■ 
Theorem 5.2: Let d be an positive integer. Let x be an arbitrary real number, x > \ — Then the 
degree distribution with average degree a and maximal degree d which maximizes the function 7(x) is 

7(x) = 7,x*-^ + 7,+ix^ (40) 

where i = [a\ is the largest integer smaller than a. 

Proof: The proof is in Appendix |Ll ■ 
The above Theorems imply that the degree distributions with fast decoding speed at the low erasure 
probability region are right-concentrated. 

B. Asymptotic Approximation Based Analysis 

In this section, we discuss the condition for the optimal degree distributions in the approximated 
constraint optimization program in Eqn. |3T1 |32l |33l |34l We have the following theorem, which shows that 
the optimal degree distributions are right-concentrated. 

Theorem 5.3: Let (A*, p*) be the solution of the constrain optimization problem in Eqns. EH 
OH with fixed maximal left degree d^ and maximal right degree d^. Then 

• If ^ < 1 — e^'^^^", then p* are non-zero only for two j's. 

• If ^ > 1 - e"^/'^% then either 

min [x-^A*(l-p*(l-x))] ^0 (41) 

xg(l-e-2/'ic,g) 

as ?7 ^ or p* are non-zero only for two j's when r] is sufficiently small. 

Proof: The proof is in Appendix |M| ■ 



VI. Numerical Examples 

In this section, we show several numerical design examples. We also compare the codes designed by 
the proposed approach to one well-known class of LDPC codes: the Heavy-tail/Poisson codes [6] [2]. 



14 




Message erasure probability at tine n-Vn iteration 
Fig. 4. The function ^A(l — p(l — x)) in tiie Example 1 

Example 1: In this example, we design a LDPC code for a BEC with parameter ^ = 0.48. The code rate 
is 0.48. The left and right degree distributions are as follows: 

X{x) = 0.1863a; + OAUSx"^ + 0.0512a;^ + 0.3482a;^^ (42) 

p(x) = 0.5330a;^ + 0.4670x^ (43) 

The function ^A(l — p(l — x)) is shown in Fig.HJas the solid line. The dashed line shows the straight line 
y = X. For r] = 10^^, The decoding convergence time = 47 in the corresponding density evolution. 
The asymptotic approximation F{\,p,r]) = 47.9400. 

We construct practical codes according to the designed degree distributions. The codeword length is 
32k bits. The simulation results on message erasure probabilities are shown in Fig.|5] The message erasure 
probabilities after different numbers of iterations are shown as the dash-dot curve. The message erasure 
probabilities by density evolution are shown as the solid curve. 



15 



0.5 r 




Fig. 5. The message erasure probabilities in the example 1 

Example 2: In the second example, we consider the BEC with parameter ^ = 0.48. The code rate is 0.5. 
We find the following left and right degree distributions: 

A(x) = 0.2452a; + 0.2982a;^ + 0.1112a;^ + 0.3454a;^^ (44) 



p(x) = 0.3398x'^ + 0.6602x^ (45) 

The function ^A(l — p(l — x)) is shown in Fig.|6las the solid line. The dash line shows the straight line 
y = X. For r] = 10~^, the decoding convergence time = 107 in the corresponding density evolution. 
The asymptotic approximation F{\,p,r]) = 108.7363. 

We construct practical codes according to the above degree distributions. The simulation results on 
message erasure probabilities after different numbers of iterations are shown in Fig. IT] as the dash-dot 
curve. The message erasure probabilities by density evolution are shown as the solid curve. The codeword 
length is 32A; bits. 
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Message erasure probability at tine n-tli iteration 
Fig. 6. The function ^A(l — p(l — x)) in tiie Example 2 

Example 3: In the third example, we design codes for the BEC with parameter ^ = 0.1. The code rate 
is 0.885. The left and right degree distributions are as follows: 

\{x) = 0.0939a; + 0.3807a;^ + 0.0443a;^ + 0. 1875a;^° + 0.2937a;^^ (46) 

p{x) = 0.4725x^^ + 0.5274x^2 (47) 

The function ^A(l — p(l — x)) is shown in Fig. [S] as the solid curve. The dash line shows the straight line 
y = X. For r] = 10~^, the decoding convergence time = 26 in the corresponding density evolution. 
The asymptotic approximation F{\,p,r]) = 26.6844. 

The simulation results on the message erasure probabilities after different numbers of iterations are 
shown in Fig. |5| The message erasure probabilities in the density evolution are shown as the solid curve. 
The codeword length is 3 2 A; bits. 

Example 4: In this example, we compare the codes designed by the proposed approach with the Heavy- 
tail/Possion codes. We consider a BEC with channel parameter ^ = 0.46. Two codes with half rate and 
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Fig. 7. The message erasure probabilities in the Example 2 



maximal degree 16 are designed. The left and right degree distributions of the Heavy-tail/Possion codes 
are as follows [2] : 

\{x) =0.3014x + 0.1507x2 + O.lOOSx^ + 0.0753x^ + 0.0604x^+ 
0.0502x^ + 0.0431x^ + O.OSTTx^ + 0.0335a;^ + 0.0301x^°+ 



0.0274x" + 0.0251x^2 + 0.0232a;^^ + 0.0215x^^ + 0.0201x^^ 



(48) 



p{x) =0.0060x + 0.0213x2 + 0.0502x^ + 0.0887x^ + 0.1255x^+ 
0.1479x*^ + 0.1495x^ + 0.1321x^ + 0.1039x^ + 0.0735x^°+ 
0.0472x" + 0.0278x^2 ^ q.OISIx^^ + 0.0077x^^ + 0.0036x^^ 



(49) 



The left and right degree distributions by the proposed design approach are as follows: 



A(x) = 0.1819X + 0.4101x2 + 0.0152x^ + 0.3928x 
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(50) 



p(x) = 0.0891x^ + 0.9109x^ 



(51) 
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Message erasure probability at the \-Vn iteration 



Fig. 8. The function ^A(l — p(l — x)) in tiie Example 3 

The decoding convergence time T^, r] = 10~^, is 47 for the code by the proposed approach and 263 for 
the Heavy-tail/Possion codes. The message erasure probabilities of the two codes by density evolution are 
show in Fig. \W\ The dash-dot curve shows the message erasure probabilities for the Heavy-tail/Poisson 
code. The solid curve shows the message erasure probabilities for the code by the proposed approach. 

These numerical results confirm our theoretical results that the derivatives of ,^A(1 — p(l — x)) with 
respect to x are close to 1 for density-efficient capacity-approaching codes. The asymptotic approximation 
F(A, p, r]) is generally tight. The proposed approach yields codes with good decoding speed. The optimal 
codes are right-concentrated. 

VII. Conclusions 

In this paper, we present a framework for designing LDPC codes with fast decoding speed. Both 
the theoretical discussion and numerical results show that Density-efficient capacity-approaching codes 
satisfy the flatness condition. Asymptotically the decoding convergence time can be approximated by 
F(A,p, r]). The asymptotic approximation is generally tight for practical scenarios. The optimal degree 
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Number of iterations 



Fig. 9. The message erasure probabilities in the Example 3 

distributions in the sense of decoding speed are right-concentrated. 



Appendix A 
The proof of Proposition 13. II 

Proof: The lower bound of (— l)[p(l — x)]' follows from the fact that 

(-i)[p(i-x)r = i;p.(j-i)(i-xr^ 

kca 

i=2 

kca 

> ^p^.(i-xri = p(i-x) 

j=2 



(52) 
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Fig. 10. The message erasure probabilities 



Note that the maximal right degree is bounded by k^a. The upper bound follows from 

kca 



V-2 



J=2 



kca 



1 kcO, 

2 T^Eftd-^r' 



i=2 

kca 



2 r=iEft(i 



i=2 



kcCi . , 



Appendix B 
The proof of Lemma [?31 

Proof: Using the change of variable x = 1 — ^^ we have 

1 .1 

p(l — x)dx = / p{v)dv = b 
Jo 

Using the change of variable x = ^A(m), we have 

\'\x/Odx= !\n\\u)du = i-- 
Jo 4 + 

The lemma follows. 



Appendix C 
The Proof of Lemma EH] 
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P(l-x) 



Fig. 11. The geometrical interpretation of xo and xi 



Proof: Let us denote x by xq for convenience and define 

1 - \-\x/i) 



c — 1 — 



pil-x) 



^ cp(l - Xo) 

Xi=Xo- 
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l-X (x/^) 



P(l-x) 



Fig. 12. The geometrical interpretation 



The geometric meaning of xi is shown in Fig. [TT] The number xi is the x coordinate of the intersection 
point of the horizontal line y = 1 — X^^{xq/^) and the straight line tangent to the curve y = p(l — x) at 
the point {xq, p{l — Xq)). 

The shadowed region in Fig. [TT] is smaller than the shadowed region in Fig. [T2| The area of the 
shadowed region in Fig. fTTlis 



2|p(l-io)l' 



The area of the shadowed region in Fig. [121 is 







1 rS. I, A TD 



Hence 



-26Ai?[p(l-xo)]' 



(e + A/?) [p{l-x,)f 

We further bound (— l)[p(l — xq)]' as in Proposition 13.11 This gives us the following bound 



(59) 



(60) 



c < 



2krAR 



(e + A/2)(l-Op(l-xo) 



(61) 



The lemma follows. 



23 




(j - 1) < kca 



(66) 



(j - 2) < k^a 



we have 



Note that 



we have 



i[A(i-p(i-x))n<^xvx 



kva 



1=3 

-\-kyk d 



1- j]p,(i-xr^ 



i-3 



X 



X 



kca 



.j=3 



i=3 



X 



i-3 



i-2 



< 1 



< 1 



i[A(i-p(i-x))n<fc,\v 



+ 



2^3 



kca 
J =3 



Further apply the following upper bounds for J2j Pji^ ~ ^ ^^'^ J2j=3Pj{^ 



1-e 



kca 



U-3 < 



i=3 



{1-xy -(1-0^ 



we have 



\[A[L - p[i - x))\ I < — (r^r^)2 — ^ — (1 _^)2 — 



25 



Appendix E 
The Proof of lemma ED 

Proof: 

Let xq G (&^,^ — &^). Let x E (0,^), x ^ xq, we have the following Taylor series expansion 

1 - \-\x/0 -p{l-x) = l- \-\xo/0 - P(l - ^o) + 
[1 - X-\xo/0]' - [P(l - xo)]'} (x - Xo) + 

[l-A-^(C/0]"-[p(l-C)r}^^^ (75) 

where C is a real number between xq and x. According to the hypotheses, ^A(l — p(l — x)) < x. This 
implies 1 — A"^(x/^) — p(l — x) < 0, and 

l-A-i(xo/0-p(l-^o)+ 

{ [1 - A-i(VO]' - [P(l - ^o)]'} (x - xo)+ 

{ [1 - A-^(C/0]" - [P(l - C)]"} < (76) 

Note that [1 — A^^(C/0]" > 0' we therefore have the following more convenient inequality: 

l-A-i(a;o/0-p(l-^o) + 
[1 - X-\xo/0]' - [p(l - xo)]'] {x - Xo) 



- [P(l - C)]" < (77) 

Set X = Xo + fe^ in the above inequality, with a little algebra we have 

[ [1 - A-^(xo/0]- ) ^ b'lpjl - or [X-\xo/0 + p(l - Xo) - 1] 
I [P(l-^o)]' j - 2[p(l-Xo]' ^ &^[p(l-a:o)]' 

To prove the lower bound in the lemma, we will bound the two terms in the right hand side of Eqn. ITSl 
separately. 

We bound the first term as follows. Since [p(l — x)]" is a monotonous decreasing function, 

[p(l - C)]" < [P(l - xo)]" (79) 
Apply the bound in Proposition 13.21 we hve 

'^\pa-xn)Y (80) 



[pii - or < j^ipii - xo)]' 
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Thus, the first term in the right hand side of Eqn. ItH] can be lower bounded 



> 



-krb 



(81) 



2[p(l-xo]' - 2(1-0 

We bound the second term in the right hand side of Eqn. |78]as follows. The second term in the right 
hand side of Eqn. |78lcan be rewritten as follows: 

p(l - xo) - 1 + A-HWO 



2^ / p(l-Xo)-l + A-^(a;o/0 



p(l - Xo) 



(-l)[p(l-xo)]' 



According to Lemma 



According to Proposition 13.1 



p(l - Xq) - 1 + A-^Xq/O 
p(l - Xo) 

p(l - Xo) 



< ^/k^B{AR,b,xo) 



< 1 



-W-xo)]', 

Hence, the second term in the right hand side of Eqn. ITHJcan be lower bounded as follows. 

p(l - Xo) - 1 + A-HWe) 



> -^Jk^B{/\R,h,x)a^ 



(82) 



(83) 



(84) 



(85) 



W-x,w 

Substituting Eqns. [85l and ISTl into Eqn. ITSl gives the lower bound in the lemma. 

We will prove the upper bound in the lemma. Set x = xq — &^ in Eqn. |771 with a little algebra we have 



[i-A-^xo/or 

[P(l-^o)]' 



1 < 



i-A-HWO-p(i-xo) 

h^W-x,)]' 
, -h'W-C)]" 



(86) 



2[p(l-xo)]' 

Since of Lemma 13.41 and Proposition 13.11 the first term at the right hand side of Eqn. |86l can be bounded 



1 - A-i(xo/0 - p(l - x_o) ^aS/KB{AR, b, x)p(l - xo) 



[p{l-xoW 



Note that the maximal right degree is bounded by kca. Hence 



(-l)[p(l-xo)]' 
<V^5(Ai?,6,x)a^ 



kra~2 



(87) 



[p(i-c)r<[p(i-^o)r 
<[p(i-^o)r 

<[pil-xo)]" 



i-C " 

1 - Xo_ 

1 -xo + 6^'''^""^ 



1 - Xo 
^5 

'—I 



kra 



(88) 
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By bounding [p(l — ()]" as in Proposition 13.21 the second term at the right hand side of Eqn. can be 
bounded by 

|p(l - Ol'V ^ , 6= ,„„, 



Substituting Eqns. 1871 and 1891 into Eqn. 1861 gives the upper bound in the lemma, 

Appendix F 
The Proof of lemma [3^7] 

Proof: Notice that 



Since [p(l — x)]' and [1 — A ^(x/^)]' are monotonously increasing, 



[p(i-^i)r ^ [p(i-^o)r (91) 



[l-A-i(a;i/0]'- [l-A-i(xi/0]' 



[p(l - xo)]' ^ [p{l-xo)]' ^^2) 



[1-X~'{xo/0]'- [l-A-i(xi/0]' 



The lemma follows. 



Appendix G 
The Proof of lemma [3l8] 



Proof: 

Denote x by xq for convenience. Define 



xi = ^X{1 - p{l - Xo)) (93) 



7/0 = p(l - Xo) (94) 



1/1 = Z/o - (a^o - a;i)[p(l - Xo)]' (95) 

The geometric meaning of xo, xi, yo, and yi is shown in Fig. [131 The point (xi,?/i) is the intersection of 
the vertical straight line x = xi and the straight line tangent to the curve p(l — x) at the point {xo,yo). 








Fig. 13. The geometrical interpretation of xo and xi. 



The area of the shadowed region in Fig. [131 is 



The shadowed region in Fig. [13] is smaller than the shadowed region in Fig. [121 

— [p(l-xo)]'(xo-xi)2<^^^ 

The lemma follows. 



Proof: Define 



Appendix H 
The Proof of Lemma [121 



yo = p(l - Xo) 
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l-X (x/^) 



P(l-x) 



Fig. 14. The geometrical interpretation of xi 



Since 6 < (1 - O/^c 



Xi =Xo + 
>Xo + 



1/0 



(-l)[p(l-a:o)] 
(1-0^ 



7 > a;o + 



/i;cp(l - a;o) 



(101) 



The geometric meaning of xi is shown in Fig. [141 The point (xi, 0) is the intersection of the x-axis and 
the straight line tangent to the curve y = p(l — x) at the point {xQ,yQ). 

The shadowed region in Fig. [I4l is smaller than the shadowed region in Fig. [121 For the area of the 
shadowed triangle region in Fig. [141 the width is Xi — Xq, the height is {xi — Ciy^/xi — Xq, and the area 
is 



(102) 



2[Xi - Xq) 

Since this area is monotonously increase with respect to xi, applying the bound for xi in Eqn. 11011 we 
have the following lower bound of the area 



2kjl-i) 

This lower bound is less than the area of the shadowed region in Fig. [12] 



(103) 



- 



(104) 



30 



The lemma follows. ■ 

Appendix I 
The Proof of Theorem 13 .101 

Proof: The proof is divided into three steps. 
Step I: We will define a partition of the interval (0,^]. 

For any n, we partition the interval (0,,^] into three subintervals (0,Co], (Co;Ci]' and (Ci!^]> where 

Co = 26^ (105) 

Ci = 1 - p;^ ((6.)^) (106) 

we claim that the partition is well-defined for sufficiently large n. That is, Co < Ci for sufficiently large 
n. Note that 

- Co) = Pn (1 - 2{hnf) = Pnj (l " 2(6„)')'"' (107) 

i=2 

Lower bounding [1 - 2{bnff~^ by [1 - 2(6„)5]''=''""\ we have 

Pn(l-Co)> [1-2(M^]'^'^"-' (108) 
This lower bound of p„(l — ^q) goes to 1, as n goes to infinity. Hence 

p„(l - Co) ^ 1 (109) 

On the other hand, 

p,(i - Ci) = (M' ^ (110) 

Since p„(l — x) is a monotonously decreasing function, we conclude that Co < Ci for sufficiently large n. 
We claim that Ci < ^ — (^n)^ for sufficiently large n. According to Lemma IJ!9l 

Pn(l-e+(M') =0((&n)'') (111) 

while by definition 

p„(i-Ci) = (M' (112) 
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Hence Ci < ^ ~ (^n)^- The claim is proven. 

Step II: In this step, we show that the derivative of the function .^A„(l — p„(l — x)) converges to 1 
uniformly in the subinterval (Co7Ci)- 

We will show that the function [.C-^n(l — p„(l — x))]' is upper bounded and this upper bound goes to 
1 uniformly as n goes to infinity. According to Lemma l3Jl 



KA„(l-Ml-))r<J^^|T(||i7 (113) 



According to lemma 1X61 



^\ ^;^'''^^}' > 1 - ^77^ - v^S(A/2.,&.,x)(l - 0(a„)^ (114) 
[Pn(l-a;)]' 2(1-0 

Also note that 

^Rn = o{{hnY'') (115) 

fi(A/?„,6„,x) = o((6„y) (116) 

We conclude that 

l\-y't,"' >i + o(y (117) 



Therefore, the function [^A„(l — p„(l — x))]' is upper bounded. 



[iK{l - Pn(l - x))]' < YT^K) (11^) 



This upper bound goes to 1 as n goes to infinity. 
We claim that for x G (Co, Ci]' 

x-eA„(l-p„(l-x)) = o((6„)5-^) (119) 

Hence for x e (Co, Ci]' 

eA„(l-p„(l-x)) > {hnf (120) 
for sufficiently large n. Denote .^A„(l — p„(l — x)) by y. According to Lemma ITSl 
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Bounding [p„(l — x)]' as in Proposition 13.11 we have 



Note that 

Pn(l - X) > pn(l - Cl) = (bnf (123) 



ARr, = o{{bnY') (124) 

We have 

Ax = o ((6„)5-5) (125) 

Therefor for sufficiently large n, 

eA„(l - p(l - x)) = X - Ax > Co - Ax > (6„)^ (126) 

We will show that the function [^A„(l — p„(l — x))]' is also lower bounded and this lower bound 
converges to 1 as goes to infinity. Note that 

[Pn(l-X)]' 



[Pn(l - y)]' \ \ [Pn(l - X)]' 



[eA„(l-p„(l-x))]' 



[l-A-Hy/On l[Pn(l-y)]', 

where y = .^A„(l — p„(l — x)). For sufficiently large n, we bound the second term as follows: 



(127) 



[Pn{l- X)]' ^ n_-x\ ^ f 1-X A '^-"-^ ^^^g^ 



[Pn{l - y)]' - \l - y J -\l-x + hl^ 
We have the following lower bound for [^A„(l — p„(l — x))]' 

KA.(1 - ..(1 - .))) > f ^^1"'"' 029) 



Since y > (6„)^, according to Lemma l3^ we have 

[Pn(l-y)]' 



[l-A-Hy/O]' 

Also 



1 as n ^ oo (130) 



— X N = " 



1 - X + 65.3 



(131) 
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as ^ oo. We conclude that this lower bound for [^Xni^ — p„(l — x))]' converges to 1 as n goes to 
infinity. 

From the above, we conclude that [^A„(l — pn{x))]' converges to 1 uniformly for x E (Co, Ci] n goes 
to infinity. 

Step III: In this step, we show that the function [^A„(l — — x))]' also converges to 1 uniformly in 
the subintervals (0, Co) and (Ci,^]- 

For X E (0, Co) 5 according to Lemma l331 

while the length of this interval is 2b^. Hence [^\n{l—pni^ — x))]' converges to 1 uniformly for x E (0, Co)- 
For X E (C15O' according to Lemma l331 

mn{l - Pn(l - X))]"\ < ^'^'[Pn(l-X)]^a^ ^ Kklp^a^-x)al ^ ^^^^^ 

while the length of this interval is bounded by 1. Hence [^A„(l — p„(l — x))]' also converges to 1 uniformly 
in the interval (C2,0- The theorem is proven. ■ 

Appendix J 
The Proof of Theorem IB.UI 

Proof: The proof is divided into four steps. 
Step I: in this step, we define a partition of the interval (0,^). 

According to Theorem 13.101 the derivative of ^A„(l — Pn(l — x)) converge uniformly to 1 for x E (0, ^] 
as n goes to infinity. There exists an e„ such that 

|[x-eA„(l-p„(l-a;))]'| <e„ (134) 

for X E (0, ^) and e„ as n ^ cxd. 

We partition the interval (r/, ^) into subintervals (xq, xi), (xi, X2), ■ ■ ■ , (x^, x^+i), ■ ■ ■ , (xm-i, x^). The 
real numbers Xj are recursively defined as follows: 

• Step (a), set k = 0, xq = rj. 
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Step (b), set 



Axk = min |--^[a;jk - ^A(l - p(l - Xk))], || 



(135) 



Xk+i = Xfe + Axk (136) 

• Step (c), if Xk+i > C-> set Xk+i = m = /c + 1 and stop. Otherwise, set k = k + 1, go to step (b). 

Step II: in this step, we show an upper bound for 

niax^g(^^,^^^^)[x - CA„(1 - - x))] 



min^g(^^,^^^^)[a; - ^A„(l - p„(l - x))] 
For each interval {xk,Xk+i), the length of the interval is at most 

1 



Hence, 



(137) 



[Xk - ^Xn{l - Pn{l - Xk))] (138) 



min [x-eA„(l-p„(l-x))] (139) 

> [Xk - eAn(l - Pn{l - Xk))][l - ^ (140) 

max [x - CA„(1 - - x))\ 

xe(a;fc,a;fc+i) 

< \Xk-i\n{y-Pn{y-Xk))\{\^^ (141) 

Therefore, we have the following upper bound 

max^s(^,,^,^^)[x - ^An(l - p„(l - x))\ ^ 1 + ^ ^^^^^ 
mm^(z(^^^^^i^^^)[x - ^An(l - Pn(l - x))] ~ 1- y/e^ 

Step III: in this step, we show lower and upper bounds for F(A, p, r])/Tjj. 

Denote the message erasure probability at Z-th iteration by PP. Let Tk be the number of pP such that 

pP G [xk,Xk+i). Note that the message erasure probability decreases at least 

min [a;-eA,(l-p„(l-a;))] (143) 



and at most 



max [x - iXn{l - Pn{l - x))] (144) 
xelxk,xk+i) 
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during each iteration. Hence, the following inequalities hold 



It follows that 



Ax,. >(Tfc-l) min [x - eA„(l - p„(l - x))] (145) 

x£[xk,Xk+i) 



Axk < {Tk + 1) max [x - ^Xn{l - p„(l - x))] (146) 



Tk > 



max3.g(^^,^^^^)[x - ^A„(l - p„(l - x))] 



min^6(^^,^^_^^)[x - ^A„(l - - x))] 



According to the bounds in Eqn. 11421 we have 



^ 1 — Ax 

Tk > max — — — - — 1 

1 + xG{xk,Xk+i) [X - 4 A„(l - Pn{l - X))\ 



1 + ^/e^ Ax 
Tk < — mm — - + 1 

1 - y/e^ xG(xfe,Xfc+i) [x - CAn(l - Pn(l " X))\ 



Note that = J2^=i Tk, we have 



Therefore, we have the following bounds for the ratio F{Xn, Pn,v)/Tri 



(147) 



(148) 



(149) 



(150) 



1 — ./^ r 1 

T„> ^/ — -dx-m (151) 

l + A/e^ir, X - 4A„(1 - p„(l - x)) 



x-^A„(l-p„(l-x))'^^"^"^ ^^^^^ 



Trj /I y/ Cn Tj^ y y 1 -|- 



Step IV: in this step, we show that the lower and upper bound in the last step all converges to 1 as n 
goes to infinity. 
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Appendix K 
The Proof of Lemma [5TT] 

Proof: We can check that 7(0;) is a valid degree distribution, Yli^i = 1 ^'^d the average degree is 

Note that and 1 are two roots of the polynomial 

2(^ + l) 2(^ + 1) x-i ^ ^ 



Hence, for < x < 

1+2 



for < X < 1, 



7(x) < 7(x) (162) 



7(x) > 7(x) (163) 



Appendix L 
The Proof of Theorem 15 .21 

Proof: 

We prove the theorem by contradiction. Assume that the degree distribution 7(0;) is nonzero for more 
than three indices or is nonzero for two non-consecutive indices. Then, either one of the following two 
cases happens. 

Case 1: there exist three consecutive indices i — 1, i, i + 1 such that 7j_i, 7i, and 7j+i are nonzero. 
Note that 

X > 1 - > (164) 

d+2 i+l ^ ' 

According to Lemma 1511 we can constructed another degree distribution 7(0;) such that 7(0;) > 7(x). 
This contradict to the hypothesis that 7(x) is optimal. 

Case 2: there exist positive integers i and j such that 7,, 7^ are nonzero, i < i + l < j, and 7^ = for 

any k, i < k < j. 
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The conditions of Lemma I5TT] is also satisfied in this case. Define 7^(0;) for each k, i < k < j, as: 

k 



7 [X) = X 



2{k + l] 



2{k + l 



-X 



(165) 



We can find real numbers Oj+i, aj+2, • • • , aj-i such that > 0, for i < A; < j, and the polynomial 



7(x) = 7(x) + 



(166) 



k=i+l 



is a valid degree distribution. The degree distribution 7(0;) has average right degree a. Since 7^(0;) > 
for each k, we have 

7(0;) > 7(0;) (167) 

This contradict to the hypothesis that 7(x) is optimal. 

The theorem follows from the discussions in the two cases. ■ 



Appendix M 
The Proof of Theorem [53] 

Proof: 

The optimal p* must also be the solution of the following constrain optimization problem with being 
fixed and equal to A*. 

1 

-dx (168) 



subject to 



mm 



x-iX{l-p{l-x)) 



^A*(l - p*(l - x)) < X, for any a; G (0,^] 



(169) 



j'l p{x)dx 
\{x)dx 



l-C + AR 



(170) 



(171) 



According to the Karush-Kuhn-Tucker condition [8], p* satisfy the following equation, for all j with 
nonzero p*. 



dpj dpj 



lo p{x)dx 
X{x)dx 



+ /3 



d ^ 







(172) 
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where a, (3 are constants. This is equivalent to 



(173) 



After finding the derivative of F(\,p,r]), we can rewrite the above equation as follows: 

/ 9{x)jil-xy ^dx = a . + pj 

where 



(174) 



^E,, A,(z-1) l-^.p^.(l-a; 



i-2 



(175) 



In Case 1, j(l — xY^^ is a concave function with respect to j. Hence g(x)j{l — xY'^dx is also 
concave with respect to j. There exist at most two j's which satisfy Eqn. 11741 The theorem is proven in 
this case. 

In Case 2, it suffices to show that if min^g(]^_g_2/dc — ^A*(l — p*(l — x))] is bounded from below, 
then p* are nonzero only for two indices when rj is sufficiently small. 
Note that 



dp 
dp 



g{x)j{l — xy ^dx 

l-cxp(-2/dc) 



g{x)j{l — xy ^dx 



+ 



df 



g{x)j{l — xy ^dx 



L^l-cxp{-2/dc) 



(176) 



We will show that the first term at the right hand side of Eqn. 11761 goes to — cxo as 77 goes to zero and 
the second term is bounded. When t] is sufficiently small, ^ g{x)j{l — xY^^dx is negative for 
2 < j < dc. Hence g{x)j{l — xy~^dx is concave with respect to j. There exist at most two j's which 
satisfy Eqn. (11741) . The theorem is proven. 

We first show the bounding of the second term. Assume for x G (1 — e'"^^^",^) 



[x-^\*il- p*{l-x))] >M 



(177) 



For X E {1 — e we can bound g{x) as follows: 



g{x) 





K{i - 1; 


(i-E,p.(i-^V" 


■) 


i^x — 


eE.A. 







< 



e4 



(178) 
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Hence, we have the following bound: 

g{x)j{l — xy~^dx 







Qj2 


11 



'l~cxp(-2/dc) 



< 



e4 



^[jii-xy-']dx 

l-cxp{-2/dc) 



(179) 



We can further bound ^ [j(l — xY ^] as follows: 

& 



— - ^y^'h 1(1 - xy-'\og{l - a;)[2 + J log(l 
<|log(l-0l(2 + 4|log(l-0l) 



(180) 



Hence, we have the following bound: 







Q2j 


11 



g{x)j{l — xy ^dx 



'l-exp{-2/(ic) 



- " ^ ~ exp(-2/4)) |log(l - 01 (2 + 4 |log(l - 01 

(181) 



Next, we will show that the first term in the right hand side of Eqn. 11761 goes to — oo as r/ goes to zero. 
According to theorem [3 .101 as x ^ 0, 



i-E/^^(i 



< 0(x' 



(182) 



i-E/^^(i 



X 



0(x) 



We also have 



^ [j(l - ^y^'] = (1 - a;)^-' log(l - x) [2 + J log(l - x)] = 0(x) 



(183) 



(184) 



[i-E/'^^i 



0{x) 



(185) 



Therefore 



^(^){^b-(i-^r^]} 



eE.A.(^-i) i-E,p.(i 



X 



n i-2 



^[J(1-^M 



>- 



^-eE.A. i-E,p.(i 



0(x)0(x) 



X 



W-1 



i-l 



0(X2) 1-^ p(l-x)J-l 



0{x) 



This implies that 



l-exp(-2/dc) 



(y'(x)j(l ~ a^)'' ^dx 



oo 



(186) 



(187) 
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as T] ^ 0. When rj is sufficiently small, g{x)j{l — xY'^dx is concave with respect to j. There exist at 
most two j's which satisfy Eqn. (I174I ). The theorem is proven. ■ 
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